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ABSTRACT 

\ 

Many  di£:ital  comr.ur.ication  channels  operating  at  low  data  rates  suffer 
onase  jitter  and  time  varying  frequency-offset  effects  which  degrade 
the  sigr.a'.  to  noise  ratio.  Low  rate  error  correction  coding  is  shown 
to  obviate  tliis  problem.  Experimental  results  are  presented  for  different  low 
rate  coding  arrangements  and  the  usefulness  of  the  technique  is  discussed  in 
i-elation  to  both  coherent  and  non-coherent  modulation  methods. 
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^ Block  schematic  of  experimental  system 
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IN'raODUCTION 


iXany  dif^ital  communication  channels  are  characterised  by  irreducible,  random 
chase  jitter  and  time  varying  frequency  offsets  which  become  important  at  low 
data  rates,  say  less  than  kO  bits/second.  For  example  on  a microwave  link 
orcratin-’  at  10  bits/aecond,  match  filter  detection  can  result  in  5 or  ^ dB 
negradation  in  signal-to-noise  r’atio. 

The  metkoci  of  overcoming  phase  jitter  fffects  examined  in  this  report  consists 
of  transmitting  over  the  channel  at  a rate  much  higher  than  the  traffic  rate, 
say  to  ?0  times  higher,  and  detecting  each  bit  individually  using  a 
conventional  match  filter  detector.  Then,  since  the  bits  are  much  shorter, 
the  effects  of  phase  jitter  are  much  less.  However,  because  the  bit  rate 
is  now  increased  to  a value  substantially  higher  than  normal  for  the  channel, 
the  bit  error  rate  can  then  only  he  kept  within  an  acceptable  limit  by  use  of 
a low-rate  error  correcting  code,  ie  a code  with  a high  level  of  redundancy. 

As  long  as  the  error  correcting  code  does  not  exhibit  a coding  loss,  the 
overall  result  can  be  a gain  of  several  dB  in  SNR. 

2.  "AOOD  LOk  RATE  CODES 

Figure  1 shows  the  theoretical  performance  in  terms  of  error  rate  versus  SNR 
for  an  ideal  coherent  F3K  modulation  system"'.  It  will  be  seen  that  for  an 
output  error  probability  of  lO-'t  a signal-to-noise  rate  of  8.4  dB  is  required. 
Using  a 1/20  rate  error-correcting  code,  that  is  transmitting  at  20  times  the 
input  data  rate,  the  ^/Nq  per  received  bit  is  13  dB  lower  at  -4.6  dB  and  the 
error  probability  is  .26.  To  have  a net  coding  gain,  the  1/20  rate  error- 
correcting  code  has  to  be  able  to  accept  an  input  error  probability  of  .26 
and  yet  deliver  output  errors  at  a rate  lower  than  10“  . 

A literatu»-e  search  has  revealed  very  few  codes  that  are  capable  of  correcting 
errors  at  very  high  levels  of  error  rate,  eg  25^.  For  example,  a (256,8) 
maximum  length  sequence  code  which  is  a l/32  rate  code  will  only  correct  up 
to  errors  in  256  bits  and  obviously  fails  at  error  rates  higher  than  0.25« 
The  5CH  farily  of  ln,k)  codes2  has  a minimum  Hamming  distance  of  2t+1  and  will 
rorrect  errors  anrroaching  t/^  rate;  for  example  one  of  the  best  such  codes, 

) only  corrects  10  errors  in  45.  In  contrast,  the  relatively  crude 
method  of  repeating  each  bit  m-1  times  is  quite  good:  for  example,  a 1/20 

rate  repeat  code  with  majority  vote  decoding  will  correct  9 or  fewer  errors 
in  20  bits. 


The  best  coding  arrangement  found  during  the  course  of  this  work  is  to  use 
repeat  coding  concatenated  with  a Viterbi  half  rate  convolutional  code.  The 
reneat  coding  part  improves  the  error  rate  from  ^.3  to  iilO“^  and  allows  the 
Viterbi  decoder  to  ooerate  with  soft  decisions.  The  Viterbi  decoder  is  then 
able  to  deliver  an  output  error  rate  of  less  than  10“5.  The  arrangement  is 
shown  in  Fig  2.  Soft  or  hard  decisions  may  optionally  be  made  on  the  bits 
prior  to  majority  vote  decoding,  but  even  with  hard  decisions  into  the 
majority  vote  circuit,  soft  decisions  are  obtained  for  use  in  the  Viterbi 
cecoder  as  described  below. 


'.vhenTor.es  have  been  received  out  of  n bits,  the  probability  of  this  pattern, 
assumir.g  •'hat  that  data  bit  is  a 1,  is 
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whet'p  e is  the  probability  of  error.  The  probability  of  the  pattern  aseuming 
the  aata  bit  is  a 0,  is 
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’fhus  the  likelihood  function  is 
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Ilie  logarithm  of  the  likelihood  is  (n-2'T)  log  and  since  scaling  is  not 
important,  the  quantity  n-2r  may  be  used  as  the  log-likelihood.  This  has  the 
useful  feature  that  it  applies  for  all  error  rates.  The  table  below  illustrates 
ar  example  where  the  soft  decisions  are  quantised  to  3 bits  and  each  data  bit 
IS  sent  7 times. 
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TABLE  1 


Number  of  ones  ( T ) 

n-2T 

Soft  Decision  Bits 

7 

- 7 

111 

6 

- 5 

110 

S 

- 3 

101 

4 

- 1 

100 

5 

1 

000 

2 

3 

001 

1 

5 

010 

0 

7 

oil 

Or.  the  other  hand  when  soft  decisions  are  made  on  the  bi^s  prior  to  majority 
vote  decoding,  the  log-likelihood  is  simply  proportional  to  the  cross 
rorrelatior.  value  of  the  received  noisy  bits  correlated  with  a pattern  of  n 
ones.  For  example  with  each  bit  of  unity  height  sent  7 times,  the  correlation 
values  are  allocated  soft  decision  bits  as  shown  below:- 
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Cross  Correlation  Value 

r • ■ ' - ■ 

Soft  Decision  Bits 

7 

111 

S 

110 

3 

101 

1 

100 

- 1 

000 

- 7 

001 

- 3 

010 

- 7 

Oil 

It  r.hould  bo  rotod  thfit  the  above  soft  decision  rules  are  only  applicable  to 
baseband  systens  or  systems  usinp  coherent  modulation  methods  since  the  noise 
has  been  assumed  to  be  Gaussian  distributed. 5 

Fcr  nor.-coherent  modulation  methods  such  as  Multi-level  Frequency  Shift  Keying 
X7SK)  and  differentially  coherent  phase  shift  keying  (DCPSK),  the  log-likelihood 
functions  have  to  be  calculated  for  specific  cases  of  SNR  and  modulation  method, 
taking  the  number  of  levels  into  account. 

=;.  EXPERIMENTAL  SYSTHl 

At:  experimental  system  has  been  built  as  shown  in  Fig  3.  This  models  a 
communication  system  at  baseband  and  so  the  results  apply  only  to  coherent 
demodulation  methods.  The  results  were  obtained  using  a DEC  PDP  11/AO  mini- 
coriouter  interfaced  to  a commercially  available  convoluti onal  encoder/Viterbi 
decoder.  The  L.nkabit  LV  7OI3  employs  a half-rate  constraint  length  7 
convolutional  encoder  and  a Viterbi  decoder.  Software  was  written  to  generate 
a T'seudo  random  natteini,  encode  the  repeats,  corrupt  the  resulting  bit  stream 
accoT-ding  to  cha.nrel  simulator  information,  decode  the  repetitive  sections  of 
the  'received'  bit  steam  to  give  soft  decision  information  to  the  Viterbi 
decoder  and  finally  to  calculate  the  error  rate  in  the  output  bit  stream. 

Two  types  of  experiment  were  nerformed.  In  Tj'pe  I experiments  it  was  assumed 
that  the  demodulator  could  only  supply  hard  decisions  to  the  inner  (repeats) 
decoder,  while  in  T'/pe  II  experiments  it  was  assumed  that  the  demodulator 
could  reliably  supnly  eight  levels  of  soft  decision  to  the  inner  decoder. 

3.1  Tyne  I Experimental  Arrangement 

In  this  arrangement  a 311  bit  pseudo  random  data  pattern  was  generated 
and  fed  out  of  the  computer  to  be  encoded  by  the  convolutional  encoder, 
the  resulting  bit  stream  at  twice  data  rate  was  then  fed  into  the  computer 
where  the  repeat  encoding  was  performed  so  that  each  bit  was  sent  n times 
wliere  n was  varied  from  7 to  19  times.  The  bit  stream,  now  at  2n  times  the 
data  rate,  was  corrupted  by  channel  simulator  software  to  yield  a stream 
With  a random,  errors  probability  between  0.23  and  0.33.  This  was  then 
nreser.ted  to  the  inner  (repeats)  decoder  subroutine  which  determined 
whether  a 0 or  1 was  more  likely  to  have  been  transmitted  and  assigned 
a confidence  or  likelihood  factor  to  it  by  use  of  Table  1.  The  soft 
decision  information  was  sent  in  parallel  to  the  Viterbi  decoder  and  the 
decoded  outnut  stream  was  fed  into  the  computer  for  error  probability 
determination. 
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5.2  Type  II  ExperimentaT'ArrangSnent 


This  arrangement  differed  in  two  major  aspects  from  the  previous  one. 

Firstly,  the  channel  simulator  section  was  required  to  assign  a likelihood 
to  each  demodulated  bit  and  secondly  the  inner  (repeats)  decoder  was 
modified  to  process  this  information  to  yield  a better  soft  decision  on 
each  output  bit  than  in  the  case  of  hard  decision  demodulation.  The 
channel  simulator  utilized  a look-up  table  similar  to  table  2.  The 
repetitions  decoder  summed  the  log-likelihoods  corresponding  to  each 
input  bit  and  normalized  the  result  by  dividing  by  the  number  of  repeats. 

4.  EXPERIMENTAL  RESULTS 

The  results  of  the  Type  I experiment  correspond  to  those  labelled  'hard'  in 
Fig  1,  because  they  represent  those  given  by  a demodulator  yielding  only  hard 
decisions  on  the  incoming  bit  stream.  One  of  the  most  striking  aspects  of  the 
results  is  that  the  net  coding  gain  is  substantially  independent  of  the  overall 
code  rate  for  repetitions  in  the  range  7 to  19.  The  fact  that  the  points  for 
different  numbers  of  repeats  lie  on  the  same  straight  line  means  that  the  extra 
rate-loss  incurred  in  using  19  repetitions  instead  of  7,  is  made  up  almost  exactly 
by  the  coding  gain  of  the  extra  repetitions.  It  should  be  pointed  out  that  this 
is  not  a fundamental  coding  theory  result  but  just  reflects  the  shape  of  the  ®^/No 
curve  for  PSK  modulation  at  the  error  rates  under  consideration.  In  all  cases 
the  simulation  proceeded  until  at  least  100  errors  were  observed  in  the  final 
output  stream. 

An  interesting  aspect  of  these  experiments  concerned  the  question  of  optimising 
the  quantization  steps  in  the  output  of  the  inner  (repeats)  decoder.  Heller 
and  Jacobs  have  indicated  that  for  eight  level  quantization,  evenly  spaced 
threshold  steps  with  spacing  = .^0~  are  optimum,  where  d"  = signal  noise  ratio. 

During  the  experiments  the  quantization  thresholds  were  optimized  for  a final 
outnut  error  rate  = lO"'^,  the  worst  at  which  the  system  was  designed  to  operate. 
These  trial  and  error  optimizations  agreed  exactly  with  the  Heller  and  Jacobs 
recommendat ions . 

The  results  of  the  Type  II  experiments,  labelled  'soft'  in  Fig  1,  indicate  that 
there  is  approximately  1 dB  to  be  obtained  by  taking  soft  decisions  (8  level) 
from  the  output  of  a coherent  demodulator.  This  compares  with  about  2 dB  usually 
gained  when  using  soft  decisions  with  a maximal  likelihood  decoding  scheme. 

The  short  fall  is  assumed  to  be  due  to  the  non-optimality  of  repeats  as  a coding 
techni ^ue. 

5.  APPLICATION  OF  RESULTS  TO  NON-COHERENT  MODULATION  METHODS 

Since  the  experimental  results  were  obtained  on  a baseband  system,  they  need 

not  always  be  valid  for  non-coherent  modulation  methods.  For  the  situation 

where  hard  decisions  are  made  prior  to  the  majority  vote  circuit,  the  results 

are  only  dependent  on  the  assumption  of  a specific  input  error  rate  and  independence 

between  bit  errors.  This  assumption  is  valid  for  non-coherent  modulation  methods 

making  hard  decisions  and  thus  the  results  may  be  applied  to  modulation  methods  . 

such  as  FSK. 

Fig  4 shows  the  overall  signal/noise  ratio  - error  rate  curve  obtained  for  a 

particular  non-coherent  modulation  method,  (differentially  coherent  phase 

shift  Keying,  DCPSK)  by  converting  the  input  error  rate  iny>  a signal/noipe 

ratio  per  received  bit  using  the  relationship  P(0)  = 46  -Eb/No  , where  Eb  is 

the  energy  per  received  repeated  bit.  The  energy  per  data  bit,  Eb  is  given  by 

Sb_  where  R is  the  rate  of  the  code,  and  the  output  error  rate,  after  error 

R Eb 

correction,  has  been  plotted  against  /Nq  in  Fig  4. 

U/.iike  the  curve  for  coherent  modulation,  the  results  show  that  lowering  the 
code  rate  introduces  a greater  and  greater  coding  loss  and  at  10-^  error  rate^ 
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code  rates  below  the  l/8  result  in  an  overall  coding  loss.  The  reason  for 
the  different  results  for  non-coherent  modulation,  as  opposed  to  coherent,  is 
due  to  the  much  larger  ^/No  values  required  for  non-coherent  modulation  when 
operating  at  high  error  rates.  For  example,  at  0.3  error  rate,  PSK  requires 
only  S.Sh  dB  SMB  while  DCPSK  requires  -2.9  dB,  a difference  of  5.7  dB.  At 
10-^  error  rate  the  difference  in  SNR  between  the  modulation  methods  is  only 
0.9  dB.  It  follows  that  an  error  correcting  code  that  produces  a 10”**  output 
error  rate  at  .3  input  error  rate  has,  before  subtracting  the  loss  in  SNR  due 
to  the  code  rate,  a coding  gain  of  17.04  dB  for  PSK  but  only  12.2  for  DCPSK. 

6.  iiXAMPLE  OF  LOW  RATE  CODING 

As  an  example  consider  a link  which  has  the  properties  set  out  in  the  following 
table. 


Transmitted  Speed  (bits/sec) 

SNR  Loss  due  to  Phase  Jitter 

10 

5 dB 

20 

4 dB 

40 

2 dB 

80 

0 dB 

The  modulation  method  is  assumed  to  be  DCPSK  and  consequently  a 10  output 
error  rate  requires  an  Eb/No  of  9* 3 dB.  For  a data  rate  of  10  bits/sec,  the 
signal  power  to  noise  spectral  density  ratio  C must  be  19.3  dB  Hz  (10  + 9»3J. 

^o 

Taking  phase  jitter  luto  account  as  above  and  using  low  rate  coding  with  results 
taken  from  Fig  4,  the  overall  C/No  required  for  different  coding  rates,  is  as 
shown  in  the  table  below 


^'^No  (dB  Hz) 

Code  Rate  (R) 

25.3 

1 

21.8 

20 

19 

1/8 

20.6 

1/18 

It  will  be  seen  that  the  optimum  code  rate  is  1/8  and  that  this  produces  an 
overall  practical  gain  in  SNR  of  6.3  dB,  and  completely  overcomes  the  phase 
jitter  loss. 

7.  PRACTICAL  CONSTRAINTS 

From  the  foregoing  it  can  be  seen  that  for  coherent  modulation,  coding  rates 
of  l/lO  to  l/j>&  may  be  successfully  used  to  reduce  the  symbol  length  by  these 
factors  and  at  the  same  time  achieve  coding  gains  of  3 dB  at  10“?  error  rate 
and  4.2  dB  at  10"5  error  rate.  Although  these  results  look  very  promising 
it  must  be  noted  that  such  modulation  methods  require  the  receiver  to  generate 
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a local  carrier  which  is  in  phase  lock  with  the  received  signal.  As  the  code 
rate  is  reduced  the  SNR  per  received  bit  is  correspondingly  reduced  and  extracting 
a phase  reference  becomes  progressively  more  difficult.  For  similar  reasons 
correct  bit  timing  and  frequency  tuning  may  also  be  very  difficult  to  achieve 
using  low  rate  codes. 

For  these  reasons  it  is  likely  that  only  non-coherent  modulation  methods  would 
be  used  with  low  rate  coding  as  there  is  then  no  need  to  obtain  a carrier  phase 
reference.  In  addition  synchronisation  would  probably  be  done  using  decision 
feedback  on  the  basis  of  testing  possible  synchronisation  positions  and  selecting 
the  one  that  gives  the  lowest  output  error  rate.  For  any  specific  application 
there  should  be  a best  compromise  between  code  rate  and  SNR  loss  due  to  phase 
jitter,  though  in  practice  code  rates  lower  than  l/8  would  probably  not  be  useful. 
It  is  worth  noting  that  using  a low  rate  code  eases  the  problems  associated  with 
frequency  variations  and  frequency  tuning,  this  being  because  the  match  filters  of 
the  received  bits  are  R times  wider  and  thus  that  much  less  sensitive  to  frequency 
offset . 
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lAbstract 

^ fany  digital  conmunication  channels  operating  at  low  data  rates  suffer  phase 
jitter  and  time  varying  frequency-offset  effects  which  degrade  the  signal  to 
noise  ratio.  Low  rate  error-correction  coding  is  shown  to  obviate  this 
nroblem.  Experimental  results  are  presented  for  different  low  rate  coding 
arrangements  and  the  usefulness  of  the  technique  is  discussed  in  relation 
I to  both  coherent  and  non  coherent  modulation  methods. 


